evaluability as a first step in evaluation rather than to assume that all programs can be evaluated.  Indeed, we commend the Department for shifting some of its evaluation resources in this direction; so far, 10 evaluability studies have been commissioned by the central evaluation unit of the Department.
WHEN TO EVALUATE
Even if a program is sufficiently specified to allow both accountability and impact evaluations, conducting impact evaluations may be inappropriate at a particular time because of the stage of program development or implementation. There are three phases in the life of a program that are notably inappropriate for impact evaluations.  The first is during the program's development. We have suggested that a proposed program be tried out under actual field conditions after it has been proved to be effective in a controlled experimental setting. The purpose of this phase is to adapt the program so that it will be maximally effective under normal operating conditions.  Obviously, impact (or summative) evaluation is totally inappropriate during this phase; at this point, evaluation should be used as a tool to fine-tune the program, not to judge it.
The second phase is after a program has been enacted and is being put into operation.  All programs require a shakedown period, during which program administrators develop regulations and operational procedures and teachers and school personnel (or other service deliverers) become familiar with the program's objectives and methods. The more complex a program, the greater the start-up problems.  When a program allows flexibility and local choice, further time must be permitted for local decision making and development of specific features. Until a program has stabilized, it ought not to be evaluted, except for fiscal accountability. Too many negative findings have, in the past, been due to premature impact evaluation.  Even accountability evaluations may be inappropriate in the early implementation stage, as demonstrated by findings on weak administration and even misuse of Title I funds in the first studies of the program, findings that did not hold up once personnel at the state and local levels had